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CLAIMS 



1. A method for automatically recognizing one or more structures in digitized image 
data, comprising Hie following steps: 

providing at least one reference graph comprising digitized reference image data of 
con^esponding reference Images, the reference graph or each reference graph compris- 
ing: 



a 
m 



a net-like structure, the respective net-like structure being defined in that specific 
reference image data have assigned thereto nodes which are interconnected by 
Hnks in a predetermined manner, and 

Jets, each node having a jet assigned thereto and each jet comprising at least 
one sul>^et \ft^ich is determined by convolutfons of at least one dass of filter 
functions with different magnitudes and/or orientations with the reference image 
data of the corresponding reference image at the specific node, or by convolu- 
tions of at least one class of fitter functions with different magnitudes and/or 
orientations with colour-segmented reference image data of the corresponding 
reference image at the specific node, or by colour information on the reference 
image data at said specific node, or by texture descriptions of tiie correspond- 
ing reference image at the specific node, said texture descriptions being gained 
. by statistical methods, or by motion vectors at the specific node, said motion 
vectors being extracted from successive reference images, 



determining an optimum image graph from the digitized image data for each reference 
graph, said optimum image graph representing for a specific reference graph the op- 
timum adaptaticwi to said reference graph and being detemnined by: 

projecting the net-like structure of said specific reference graph into the image 
data whereby the structure of the image graph is defined, and 
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determining sub-jets of the image graph at the nodes defined by its stmcture, said 
sublets coH'esponding to at least part of the detennined sub-Jets of the specific 
reference graph, and 

the projecfion of the net-like stmcture of said specific reference graph being varied 
until a graph comparison function which compares the jets of the image graph 
with the corresponding jets of said specific reference graph becomes optimal, 

associating the structure or each structure with tiie reference image corresponding to the 
reference graph for which the graph comparison function is optimal with respect to the 
optimal image graph detenmined for said reference graph. 

2. The method according to claim 1 . virtierein in addition 

a plurality of reference graphs is provided, and 

the reference graphs, which have net-like stmctures that are topologlcally identical, are 
combined to form a reference bunch graph, said reference bunch graph comprising; 

a net-like stmcture defined by nodes which correspond to the nodes of the refer- 
ence graphs and by links which are determined by averaging the corresponding 
links of the reference graphs, and 

bunch jets, each of said bunch jets being composed of the sub-jets corresponding 
to the sub-jets at the respective nodes of the reference graphs combined in the 
reference bunch graph; 

and 

an optimum image graph is determined for the or for each reference bunch graph, 
said optimum image graph representing for a specific reference bunch graph the op- 
timum adaptation to said reference bunch graph and being determined by; 
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projecting the net-like stwcture of said specific reference bunch graph into ttie 
image data whereby the striKiture of the image graph is defined, and 

determining sub-jets corresponding to at least part of the sut>-jets which have 
been used for detemiining the sub-Jete of the reference graphs underlying the 
specific reference bunch graph, and 

the projection of the net-lil<e structure of said specific reference bunch graph being 
varied until a graph comparison function which compares the jets of the image 
graph with the conBSponding bunch jets of said specific reference bunch graph 
becomes optimal, 

each sub-jet of the image graph being compared with the sublets in ttie corre- 
[U spending bunch jet of said specific reference bunch graph; 

3 

I and wherein finally 

I; J each staicture is associated with the reference image corresponding to the reference 
va graph or to the reference graph from the reference bunch graph or graphs for which the 

graph comparison function is optimal with respect to the optimal image graph detenmined 

for said reference graph. 

3. The method according to daim 2, wherein only part of the reference graphs provided 
are combined so as to fomr* one or a plurality of reference bunch graphs. 

4. The method according to claim 2. wherein all the reference graphs provided are com- 
bined so as to fomi one or a plurality of reference bunch graphs. 

5. The method according to one of the preceding claims, wheran the stmcture of the 
node-assodated jets, which is determined by the sub-jets, depends on the respective 
node. 
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6. The method according to one of the claims 1 to 4, wherein the structure of the node- 
associated jets, which is determined by the sublets, is identical for all nodes. 

7. The method according to one of the preceding claims, wherein a graph comparison 
function is used, which comprises a jet comparison function that takes into account the 
similarity of the jets corresponding to one another. 

8. The method according to claim 7, wherein the graph comparison function additionally 
comprises a comparison function for the net-like structure, which takes into account the 
metric similarity of the image graph and the corresponding reference graph or the corre- 
sponding reference bundi graph. 

g. The method according to claim 8, wherein the graph comparison function is defined 
rf 5 as a weighted sum of the jet comparison function and of the comparison function for the 
net-like structure. 

9 

10. The method according to one of the claims 7 to 9, wherein the jet comparison func- 
i;3 tion is defined as a function of single jet comparison functions of jets corresponding to 
TT one another. 

'.a 

p: 11. The metiiod according to daim 1 0, wherein the jet comparison function is defined as 
a weighted sum of the single jet comparison functions and/or as a weighted product of 
the single jet comparison functions. 

1 2. The method according to daim 1 0 or 11 , wherein sub-jets of tiie corresponding jets 
are taken into account for determining a single jet comparison, and wherein a single jet 
comparison function is defined as a function of sub-jet comparison functions, 

13. The metiiod according to claim 12. wherein the single jet comparison functions are 
defined as weighted sum of the sub-jet comparison functions and/or as a weighted prod- 
uct of ttie sub-jet comparison functions and/or as extremum of the sub-jet comparison 
functions. 
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14. The method according to one of the claims 7 to 13, wherein different node- 
dependent jet comparison functions and/or single jet comparison functions and/or sub-jet 
comparison functions are used. 

16. The method according to one of the claims 7 to 9 in combination with claim 2, wherein 
the bunch jets of the reference bunch graph B" are divided into sub-bunch jets b" , and 

the jet comparison function between the sub-bunch jets b" of the reference bunch graph 
and the con-esponding sub-jets j,' of the image graph G' for n nodes for m recursions is 
calculated according to the following formulae: 

n S^(B".(?) = 2:a)„S„{B:'.j;).or 

% Sj^{B".G) = n(S„(B^J;)r, wherein 

^ n 

i'U 

m. 

S o Js a weighting factor for the n-th node n, and the comparison function S„{B^, J„* ) 
for the n-th node of the reference l>undi graph with the n-th node of the image graph 
£f is given by: 

ifi 

fi S(B^ J) = f2({s„(b!r.j,')))=:n(M). with 

Q«')(M) = 2^(Din[^(M['>),or 

i 

ft«»(M)=nK(Mr)r.°r 

n<°>(M) = max{(DiQP(Mf>)} , or 

n<">(M) = minfoa A^^(MP)} , wherein (J^P = M 
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n(m-D(^(D J ^ J^(£2|'»)(Mj"'>))"' , or 
Q(m-Dj,^(m-D J ^ ^ax{a) p(Mf ' )} . or 

Q(m.D(^«.»-D) ^ minfcD jnfHMS™^)} , wherein (JMP = M^''^ and with 
S(b«,j') = 2:(D„S„(J«.J').or 

n 

s{b".r)=n(s„{i"r)r.or 

n 

S(b",j')=max{(D„S„(Ci')}.or 
S(b".r} = min{(D„S,(iS'.i')}- 

Q 

16. The method according to daim 15, wherein the sub-bunch jets of the reference 

'■'J * 

fi^ bunch graph or graphs comprise only features which have been determined by convolu- 
□ tions of at least one class of filter functions with different magnitudes and/or OTentations 
' ' ^ with the reference image data of the corresponding reference image at the specific node, 
wi or by convolutions of at least one class of filter functions with different magnitudes and/or 
it orientations with colour-segmented reference image data of the corresponding reference 
image at said specific node, or by colour information on the reference image data at said 
k% specific node, or by texture descriptions of the oonresponding referwice image at said 
specific node, said texture descriptions being gained with statistical methods, or by mo- 
tion vectors at said specific node, said motion vectors being extracted from successive 
reference images. 

17, The method according to claim 15, wherein the sub-bunch jets of the reference 
bunch graph or graphs comprise only features which result from a reference graph. 

ia The method according to one of the preceding claims, wherein, after the recognition 
of each structure, a step for detennining the significance of the recognition is provided. 
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19. The method according to daim 18. wherein an estimator is used for determining the 
significance, said estimator taking into account the optimum graph comparison function 
as well as the non-optimum graph comparison function. 

20. The method according to claim 19, wherein the distance of the values of the non- 
optimum graph comparison functions from the value of the optimum graph comparison 
function is used as an estimator. 

21. The method according to one of the preceding claims, wherein, in addition, each 
structure is associated with the reference Images corresponding to the reference graphs 
and/or the reference graphs from the reference bunch graphs for whidi the values of the 

' :| graph comparison functions lie within a predetermined range, 

'Si 

m 

fii 22. The method according to one of the preceding daims, wherein the colour infbrma- 
;i! tion comprises hue values and/or colour saturation values and/or intensity values de- 
termined from the reference Image data and the image data, respectively. 

if 

U4 

;=7 23. The method according to one of the daims 1 to 22, wtierein ttie step of providing the 
If reference graphs and the reference bunch graphs, respectively, comprises fetching the 
CI reference graphs and the reference bunch graphs from a central and/or decentralized 
data base. 

24. The method according to one of the preceding claims, wherein a regular grid is used 
as a net-iike structure of the reference graph, the nodes and links of said regular grid 
defining rectangular meshes. 

25. The method according to one of the claims 1 to 23, wherein an irregular grid is used 
as a net-like structure of the reference graph, the nodes and links of said irregular grid 
being adapted to the structure to be recognized. 

26. The method according to daim 25. wherein the nodes are assodated with charac- 
teristic points, so-called landmari^s, of the structure to be recognized. 
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27. The method acxxirding to one of the preceding claims, wherein Gabor filter functions 
and/or Mallat filter functions are used as class of filter functions for convolution with the 
reference image data and image data, respectively. 

28. The method according to one of the preceding claims, wherein Gabor filter functions 
and/or Mallat filter functions are used as class of filter functions for convolution with the 
colour-segmented reference image data and image data, respectively. 

29. The method according to one of the preceding daims, wherein the projection of the 
net-like structure of the specific reference graph and/or the specific reference bunch 

^ graph comprises centering the reference graph and/or the specific reference bunch 
Si graph In the image, 

m 
m 

3 30. The method according to claim 29. wherein the projection of the net-like structure of 
m the specific reference graph and/or of the specific reference bunch graph comprises a 
%. displacement and/or rotation of the centered reference graph and of the centered refer- 
*=3 ence bunc* graph, respectively. 

i z 

^ 31 . The method according to claim 29 or 30, wherein the projection of the net-like 
structure of the spedfic reference graph and/or of the specific reference bunch graph 
comprises scaling the centered reference graph and the centered reference bunch graph, 
respectively. 

32. The method according to daim 31 in combination with daim 30, wherein the dis- 
placement and the scaling and the rotation of the centered reference graph and of the 
centered reference bundi graph, respectively, are carried out simultaneously. 

33. The method according to one of the daims 29 to 32, wherein the projection of the 
net-like structure comprises local distortions of the centered reference graph. 
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34. The method according to claim 33, wherein a local distortion is caused by locally 
displacing a respective node of the centered reference graph. 

35. The method according to one of the claims 30 to 34, wherein the displacement 
and/or the scaling and/or the rotation are determined on the basis of a comparison be- 
tween the image graph and the corresponding reference graph and/or the corresponding 
reference bunch graph. 



